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(g) A method for utilizing a low resolution touch screen system in a high resolution graphics 
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(57) A relatively low resolution touch screen sys- 
tem is utilized in a graphic display environment 
wherein the resolution of the graphic display is 
relatively high. The character resolution yields a 
lower target resolution, a single character being 
the target (or the desired character). The 
method zooms a predetermined number of 
characters around an initially reported position, 
the zooming increasing the character resol- 
ution such that target resolution is decreased to 
a value resulting in a touch screen resolution at 
least equal to or higher than resolution of the 
target resolution. Further, as the stylus is moved 
toward the desired character, a new position of 
the stylus is calculated. A check is made to 
determine if the new position is within the 
zoomed area. If it is, the processing continues ; 
otherwise the screen is rezoomed around the 
new position. When the desired character is 
under the pointing element, the pointing ele- 
ment utilized to reverse the calculation thereby 
identifying the position of the desired character, 
and thus the desired character itself. 



PLANT CONTROL NETWORK - \ I 
122 124 126 





\ 












US 




AM 




HM 




CM 



120 



PROCESS CONTROLLER - 20 PROCESS CONTROLLER — 2Q 



, a/1 



"i — i — r 

A/0 0/1 D/0 



^601 



Y 

TO/ FROM 
FIELD DEVICES 
(GUAGES, VALVES....) 



— i — i — i — r- 

^ A/1 A/0 0/1 O/O j 



TO/FROM 
FIELD DEVICES 



UJ 



Jouve, 18, rue Saint-Denis, 75001 PARIS 



1 



EP 0 575 146 A2 



2 



BACKGROUND OF THE INVENTION 

The present invention relates to graphic display 
systems, and more particularly, to a method for util- 
izing a touch screen system having a relatively low re- 
solution in a relatively high resolution graphics envir- 
onment. 

Presently, touch screen systems are utilized 
which allows direct information input to an information 
processing apparatus from a coordinate position on a 
display screen by pointing out a desired position on a 
display of a cathode ray tube (CRT) display device (or 
some other like device). This technique is well accept- 
ed and has become the accepted standard for proc- 
ess operator interaction today. However, this technol- 
ogy utilizes a low resolution infrared LED touch 
screen with a resolution of 127 by 95 to select targets 
on a display with a resolution of 640 by 448. Even 
though the touch screen resolution is lower than that 
of the display, selecting targets was not a problem 
since the minimum target size is 8 by 8. This results 
in a target resolution of 80 by 56 which is less than the 
resolution of the touch screen. 

However, when higher resolution displays are 
utilized, such as a display having a 1280 by 1024 re- 
solution for example, the resultant target resolution is 
160 by 128. Thus, targets on this high resolution dis- 
play cannot be selected with the current touch screen 
resolution. Thus there is provided by the present in- 
vention, a method whereby a low resolution touch 
screen system is utilized to permit target selection on 
a high resolution graphics display. 

SUMMARY OF THE INVENTION 

Therefore, there is provided by the present inven- 
tion, a method for utilizing a low resolution touch 
screen with a high resolution graphics display. The 
method of the present invention selects a character 
being displayed on a display using a pointer element. 
The display has a first resolution and a touch screen 
system associated with the display has a second re- 
solution. The character has a third resolution resulting 
in a target resolution, such that the target resolution 
is higher than the resolution of the touch screen sys- 
tem. The touch screen system transmits to a data 
processing unit processing the display, an X and Y co- 
ordinate signal of the pointed character. The method 
comprises the steps of, when a character is pointed 
to, accepting an initial X and Y coordinate value from 
the touch screen system, and calculating a corre- 
sponding X and Y coordinate value of the display. 
Then the initial X and Y coordinate values and the 
corresponding calculated X and Y coordinate values 
are saved. The display is zoomed a predetermined 
number of characters around the initial X and Y coor- 
dinate values. If the character to be selected is not un- 
der the pointer, the pointer element is moved towards 



the desired character, otherwise the pointer element 
is withdrawn. Updated X and Y coordinate position 
values of the pointer location is continually accepted 
on a periodic basis. A new point is calculated to de- 
5 termine if the new point (i.e., the pointer element) is 
within the zoomed area. If it is, the processing con- 
tinues; otherwise, the display is restored and the dis- 
play is rezoomed around the new point. The pointer 
element is moved until the desired character is under 
w the pointer. The pointer element is then withdrawn, 
the new point calculated from above having the and 
Y coordinate values of the desired character, thereby 
permitting the desired character to be selected. 
Accordingly, it is an object of the present inven- 
ts tion to provide a method for utilizing a low resolution 
touch screer with a high resolution graphics display. 

It is another object of the present invention to pro- 
vide a method for utilizing a low resolution touch 
screen to select a character of a display whereby th 
20 display as a relatively high resolution. 

These and other objects of the present invention 
will become more apparent when taken in conjunction 
with the following description and attached drawings, 
J wherein like characters indicate like parts, and which 
25 drawings form a part of the present application. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 shows a block diagram of a process con- 
30 trol system of the preferred embodiment in which 

the present invention is utilized; 
Figure 2 shows a block diagram of common ele- 
ments of each physical module of the process 
control system of Figure 1 ; 
35 Figure 3 shows a functional block diagram of a 

typical physical module of the process control 
system; 

Figure 4 shows a partial, functional block diagram 
of the existing system and the opened system of 
40 the preferred embodiment; 

Figure 5 shows a functional block diagram of an 
open operator station of the preferred embodi- 
ment; 

Figure 6 shows a block diagram of a graphics 
45 card of the preferred embodiment of the univer- 

sal station; 

Figure 7, which comprises Figures 7A and 7B. 
shows examples of screen displays of the display 
unit of the process control system; 
so Figure 8 shows a flow diagram of the method of 

the present invention; 

Figure 9 shows a partial display screen showing 
a partial row of characters with the correspond- 
ing display pixel value and beam of the touch 
55 screen system; and 

Figure 10 shows a partial expanded character 
display of Figure 9 according to the method of the 
present invention. 
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DETAILED DESCRIPTION 

Before describing the method of the present in- 
vention, it will be helpful in understanding a system 
environment in which the invention is utilized. Refer- 
ring to Figure 1, there is shown a block diagram of a 
process control system 10 of the preferred embodi- 
ment in which the present invention can be found. The 
process control system 10 includes a plant control 
network 11 , and connected thereto is a data highway 
12, which permits a process controller 20' to be con- 
nected thereto. In the present day process control 
system 10, additional process controllers 20' can be 
operatively connected to the plant control network 11 
via a corresponding highway gateway 601 and a cor- 
responding data highway 12. A process controller 20, 
an interface apparatus which includes many new, ad- 
ditions, improvements, and features over the process 
controller 20', is operatively connected to the plant 
control network 11 via a universal control network 
(UCN) 14 to a network interface module (NIM) 602. 
In the preferred embodiment of the process control 
system 10, additional process controllers 20 can be 
operatively connected to the plant control network 11 
via a corresponding UCN 14 and a corresponding 
NIM 602. The process controllers 20, 20' interface the 
analog input and output signals, and digital input and 
output signals (A/I, A/O, D/l, and D/O respectively) to 
the process control system 10 from the variety of field 
devices (not shown) of the process being controlled 
which include valves, pressure switches, pressure 

gauges, thermocouples 

The plant control network (or more simply net- 
work) 11 provides the overall supervision of the con- 
trolled process, in conjunction with the plant operator, 
and obtains all the information needed to perform the 
supervisory function, and includes an interface with 
the operator. The plant control network 11 includes a 
plurality of physical modules, which include a univer- 
sal operator station (US) 122, an application module 
(AM) 124, a history module (HM) 126, a computer 
module (CM) 128, and duplicates (backup or second- 
ary) of these modules (and additional types of mod- 
ules, not shown) as necessary to perform the re- 
quired control/supervisory function of the process be- 
ing controlled. Each of these physical modules is op- 
eratively connected to a local control network (LCN) 
120 which permits each of these modules to commu- 
nicate with each other as necessary. The NIM 602 
and HG 601 provide an interface between the LCN 
120 and the UCN 14, and the LCN 120 and the data 
highway 12, r spectively. 

Physical modules 122, 124, 126, 128,... of net- 
work 11 of the preferred embodiment are of various 
specialized functional types. Each physical module is 
the peer, or equivalent, of the other in terms of right 
of access to the network's communication medium, 
or LCN 120, for the purpose of transmitting data to 



other physical modules of network 11. 

Universal operator station module (US) 122 of 
network 1 1 is a work station for one or more plant op- 
5 erators. It includes an operator console which is the 
interface between the plant operator, or operators, 
and the process or processes of the plant for which 
they are responsible. Each universal operator station 
module 122, is connected to the LCN 120, and all 
10 communications between the universal operator sta- 
tion module 122, and any other physical module of 
network 11, is via the LCN 120. Universal operator 
station module 122 has access to data that is on the 
LCN 120 and the resources and data available 
15 through, or from, any of the other physical modules 
of network 11. The universal station module 122 in- 
cludes a cathode ray tube display (CRT) (not shown) 
which includes a video display generator, an operator 
keyboard (KB) (not shown), a printer (PRT) (not 
20 shown), and can also include (but not shown) a car- 
tridge disk data storage device, trend pen recorders, 
and status displays, for example. 

A history module (HM) 126 provides mass data 
storage capability. The history module 126 includes 
25 at least one conventional disk mass storage device 
such as a Winchester disk, which disk storage device 
provides a large volume of nonvolatile storage capa- 
bility for binary data. The types of data stored by such 
a mass storage device are typically trend histories, 
30 event histories, ....or data from which such histories 
can be determined, data that constitutes or forms 
CRT type displays, copies of programs for the phys- 
ical modules.... 

An application module (AM) 124 provides addi- 
35 tional data processing capability in support of the 
process control functions performed by the control- 
lers associated with the process control subsystem 
20, 20' such as data acquisition, alarming, batch his- 
tory collection, and provide continuous control com- 
40 putational facilities when needed. The data process- 
ing capability of the application module 124 is provid- 
ed by a processor (not shown) and a memory (not 
shown) associated with the module. 

Computer module (CM) 1 28 uses the standard or 
45 common units of all physical modules to permit a me- 
dium-to-large scale, general purpose data processing 
system to communicate with other physical modules 
of network 11 and the units of such modules over the 
LCN 120 and the units of process control subsystems 
so 20, 20' via the highway gateway module 601 , and the 
NIM 602, respectively. Data processing systems of a 
computer module 128 are used to provide superviso- 
ry, optimization, generalized user program prepara- 
tion and execution of such programs in higher level 
55 program languages. Typically, th data processing 
systems of a computer module 128 have the capabil- 
ity of communicating with other such systems by a 
communication processor and communication lines. 
The local control network 120 (LCN) is a high- 
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speed, bit serial, dual redundant communication net- 
work that interconnects all the physical modules of 
plant control network 11. LCN 120 provides the only 
data transfer path between the principal sources of 
data, such as highway gateway module 601, applica- 
tion module 124, and history module 126, and princi- 
pal users of such data, such as universal operator sta- 
tion module 122, computer module 128, and applica- 
tion module 124. LCN 120 also provides the commu- 
nication medium over which large blocks of data, such 
as memory images, can be moved from one physical 
module such as history module 126 to universal sta- 
tion module 122. LCN 120 is dual redundant in that it 
consists of two coaxial cables that permit the serial 
transmission of binary signals over both cables. 

Referring to Figure 2, there is shown a block di- 
agram of the common elements of each physical 
module of the network 11 or the process control sys- 
tem 10. Each of the physical modules includes a mod- 
ule central processor unit 38 and a module memory 
40, a random-access memory (not shown), and such 
additional controller devices, or units (not shown), 
which are configured to provide the desired function- 
ality of that type of module, i.e., that of the operator 
station 122, for example. The data-processing capa- 
bilities of each module's CPU 38 and module memory 
40 create a distributed processing environment which 
provides for improved reliability and performance of 
network 11 and process control system 10. The reli- 
ability of network 11 and system 10 is improved be- 
cause, if one physical module of network 11 fails the 
other physical modules will remain operational. As a 
result, network 11 as a whole is not disabled by such 
an occurrence as would be the case in centralized 
systems. Performance is improved by this distributed 
environment in that throughput and fast operator re- 
sponse times result from the increase computer proc- 
ssing resources, and the concurrency and parallel- 
ism of the data-processing capabilities of the system. 

As mentioned above, each physical module in- 
cludes the bus interface unit, BIU, 32 which is con- 
nected to the LCN 120 by the transceiver 34. Each 
physical module is also provided with the module bus 
36 which, in the preferred embodiment, is capable of 
transmitting 16 bits of data in parallel, between the 
module CPU 38 and the module memory 40. Other 
units, utilized to tailor each type of physical module to 
satisfy its functional requirements, are operatively 
connected to module bus 36 so that each such unit 
can communicate with the other units of the physical 
module via its module bus 36. The BIU 32 of the phys- 
ical module initiates the transmission of data over 
LCN 120. In the preferred embodiment, all transmis- 
sions by a BIU 32 are transmitted over the coaxial 
cables which, in the preferred embodiment, form the 
LCN 120. 

Referring to Figure 3 there is shown a functional 
block diagram of a typical physical module 122, 124, 



126, 128 of the plant control network 11, and includes 
the bus interface unit (BIU) 32 and the transceiver 34, 
which connects BIU 32 to the LCN 120. BIU 32 is ca- 

5 pable of transmitting binary data over LCN 120 and of 
receiving data from LCN 120. Transceiver 34 in the 
preferred embodiment, is transformer coupled to the 
LCN 120. In the preferred embodiment, the LCN 120 
is a dually redundant coaxial cable with the capability 

10 of transmitting bit serial data. BIU 32 is provided with 
a very fast micro-engine 56. In the preferred embodi- 
ment, micro engine 56 is made up of bit slice compo- 
nents so that it can process eight bits in parallel, and 
can execute a 24 bit microinstruction from its pro- 
fs grammable read only memory (PROM) 58. 

Signals received from the LCN 120 are transmit- 
ted by transceiver 34 and receive circuitry 52 to re- 
ceive FIFO register 54. Micro engine 56 examines the 
data stored in FIFO register 54 and determines if the 

20 information is addressed to the physical module. If 
the data is an information frame, the received data is 
transferred by direct memory access (DMA) write cir- 
cuitry 66 by conventional direct memory access tech- 
niques to the physical module memory unit (MMU) 40 

25 over module bus 36. 

Communication between MCPU processor 68, a 
Motorola 68020 microprocessor in the preferred em- 
bodiment, and other functional elements of MCPU 38 
is via local microprocessor bus 39. Module bus inter- 

30 face element 41 provides the communication link be- 
tween local bus 39 and module bus 36. Processor 68 
executes instructions fetched from either its local 
memory 43, in the preferred embodiment an EPROM, 
or from MMU 40. Processor 68 has a crystal control- 

35 led clock 45 which produces clock pulses, or timing 
signals. Input/output (I/O) port 49 provides communi- 
cation between MCPU 38 and equipment external to 
the physical module to permit program loading, and 
the diagnosis of errors, or faults, for example. 

40 Each MCPU 38 includes a timing subsystem 48 

which, in response to clock signals from module clock 
45 produces fine resolution, synchronization, and 
real-time, timing signals. Any timing subsystem 48 
which is provided with a timing subsystem driver 50, 

45 has the capability of transmitting timing information to 
other physical modules over the LCN 120. Another in- 
put to each timing subsystem 48, is timing information 
which is transmitted over LCN 120 and which is re- 
ceived through transceiver 34, timing receiver 55 and 

so timing driver 57 of BIU 32. Timing pulses from module 
power supply 59 which are a function of the frequency 
of the external source of A.C. electric power applied 
to pow r supply 59 are used by timing subsystem 48 
to correct longer term frequency drift of the clock 

55 pulses produced by clock 45. 

Additional information of the BIU 32 can be found 
in U.S. Patent No. 4,556,974. Amore detailed descrip- 
tion of the process control system 10 can be had by 
referring to U.S. Patent No. 4,607,256. Additional in- 
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formation of the individual, common, functional 
blocks of the physical modules can be had by refer- 
ence to U.S. Patent No. 4,709,347, ail of the above- 
identified patents being assigned to the assignee of s 
the present application, and additional information of 
the process controller 20' can be had by referencing 
U.S. Patent No. 4,296,464. 

The addition of an interface apparatus which in- 
terfaces ot her systems to the process control system 10 
10 described above and a modification to a graphics 
generator in the US 122 opens up the existing sys- 
tem, specifically the graphics interface, which in- 
cludes designing in the capability to readily permit 
nodes of differing designs to communicate to the net- 1 5 
work, and will now be described. 

Referring to Figure 4, there is shown a partial 
functional block diagram of the existing system and 
the open (or opened) system. The universal operator 
station (US) 122 is coupled to a co-processor 200, 20 
and the co-processor is coupled to an open system, 
i.e., interfaces/protocols of differing design, including 
task control program/interface protocol (TCP/IP), 
open system interface (OSI), DECnet (a product of 
the Digital Equipment Corporation of Maynard, Mas- 25 
sachusetts) The universal station 1 22 is also con- 
nected to the LCN 120 as described above. Thus, the 
new universal operator station (open US) 123 in- 
cludes the US 122 as described above in conjunction 
with the co-processor 200. The purpose of the open 30 
US 123 is to open the graphical interface to the open 
systems and to provide information from the closed 
US to the open systems. The co-processor 200 is 
structured to permit the interface to other systems, 
i.e., the open systems without jeopardizing the integ- 35 
rity of the existing system. The co-processor 200 of 
the preferred embodiment is a Motorola 68040 micro- 
processor which is executing the UNIX operating sys- 
tems (UNIX is an operating system of the American 
Telephone and Telegraph Company, ATT, is readily 40 
available and is well known to those skilled in the art), 
and is sometimes referred to as a UNIX co-processor. 

Referring to Figure 5, there is shown a functional 
block diagram of the open operator station 1 23 of the 
preferred embodiment The operator station 122 as 45 
described above includes the BIU 32 connected to 
the module bus 36, the module memory 40, and the 
module CPU 38, both also connected to the module 
bus 36. These basic functional blocks are contained 
in all the physical modules. Additional functional so 
blocks added to the physical module is what gives the 
physical module its personality apart from any other 
physical module. The operator station 122 includes a 
graphics card 150 which interfaces with a display 
(CRT) and a keyboard (KB) 1 51 , 1 53. A shared mem- 55 
ory 202 is included and is also connected to the mod- 
ule bus 36 which provides for communication be- 
tween the co-processor 200 and the US physical 
module 122 (thereby providing communication to the 



rest of the process control system 10 via the module 
CPU 38). Thus, the co-processor 200 requests ser- 
vice (e.g., the value of a point, contents of a file,... or 
any information of the process control system 10) of 
the module CPU 38 through shared memory 202. The 
module CPU 38 then communicates with the appro- 
priate modute to perform the requested service in a 
normal fashion. Once the response is obtained the in- 
formation is passed to the co-processor 200 via 
shared memory 202. Since the module CPU 3 is com- 
municating via the LCN 120, the integrity of the LCN 
(i.e. , the system) is maintained and similarly the mod- 
ul memory 40 cannot be corrupted by the co-proces- 
sor 200. 

Also shown in Figure 5 is an example open sys- 
tem (or foreign system), for example, a Digital Equip- 
ment Corporation system which includes the DECnet 
network and protocol and DEC processor 300 attach- 
ed to the DECnet network. In th preferred embodi- 
ment, the communication between the DEC ope sys- 
tem and the co-processor 200 is via an X-windows 
protoco (X-windows being a protocol defined by the 
Massachusetts Institute of Technology, Cambridge, 
Massachusetts) fo: graphical display information, and 
other open systems stan dards being used for data 
exchange. Any requests of the outside system to the 
LCN is made via the co-processor 20( through the 
shared memory 202 to the module CPU 38 as descri- 
bed above. 

It is also desired to open up the graphics inter- 
face such that a display which is not on the LCN can 
be displayed onto the CRT 151 of the US 122. This 
is achieved by the interface to the graphic card~150 
from the co-processor 200. Referrinc to Figure 6, 
there is shown a block diagram of the graphics card 
1 50 of the preferred embodiment The graphics card 
includes a card bus 1 52. Attached to the card bus 1 52 
is a data memory 154 which contains the information 
which is to be displayed onto the CRT, and also con- 
tains some control information. A microprocessor 156 
is also coupled to the care bus 152 and further is cou- 
pled to the module bus 36. graphics processor 160 is 
coupled to the card bus 152 anc performs all the 
processing for developing the informatior stored in 
the data memory 154, including some control func- 
tions. Ashared memory 158 is coupled to the card bus 
152. A connection is made from the card bus 152 to 
the co-processor 200, thereby providing the interface 
mentioned above to the graphics card 150 from the 
co-processor 200. The microprocessor 156 of the 
preferred embodiment of the graphic card 15 is a Mo- 
torola 68020 processor. The graphics card 150 is a 
two port graphics card, one port of the graphics card 
b ing tied to the module bus 36 which is how a display 
is driven from LCN. The LCN 120 provides a "single 
window to the process," i.e., a screen display of what 
the process/process control system is doing. The sec- 
ond port is coupled to the co-processor 200 and pro- 
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vides the windows interface for the universal station 
122. The windows interface is the X-windows inter- 
fac which is well defined and well known to those 
skilled in the art (the interface being defined by MIT, 
Cambridge, Massachusetts). It is through the inter- 
face from the co-processor 200 that all the window 
displays [i.e., the screen display(s) of the open sys- 
tem(s)] and windows controls are performed, includ- 
ing commands to the graphic card 150 to specify 
where to place the single window to the process on 
the screen of the CRT 151. The interface between 
the graphics card 150 and the co-processor 200 is 
the full windows interface. One of the windows is the 
display referred to above as the "single window to the 
processor" (sometimes referred to as the LCN win- 
dow). The co-processor 200 commands the graphics 
card 150 where the LCN window is to be placed on 
the CRT 151 and its relative size on the display. X- 
windows is a well defined protocol of how to commu- 
nicate with the graphics card 150 (or any graphics 
card) and display, and a computer permitting many 
windows to be displayed. This includes displaying at 
least one window from the LCN and/or at least one 
window from the open system 300. In this system, a 
server is defined in X-windows as the machine that 
is driving the display (or that portion of the co-proc- 
essor 200 which interfaces to the graphics card 150), 
and a client is the application program, in the pres- 
ent embodiment, the DEC processor 300. 

The client 300 can have data which is desired to 
be displayed. The client 300 communicates with the 
server portion of the co-processor 200 through an X- 
windows protocol indicating data to be displayed. The 
server portion of the co-processor 200 communi- 
cates with the graphics card 150 through a device de- 
pendent layer (DDL) and is provided by the vendor of 
the graphics card, or in X-windows is via DDX proto- 
col. The microprocessor 1 56 maintains the integrity of 
t he card bus 1 52 into the data memory 1 54. The proc- 
essing of the data to be displayed on the CRT 151 is 
performed by the graphics processor 160. When a 
predetermined data screen is to be displayed, the mi- 
croprocessor 156 (which accepts requests from the 
LCN 1 20 via module bus 36) places the data in shared 
memory 158, and is subsequently processed by the 
graphics processor 160, and is then stored in data 
memory 1 54. When the open system 300 (via the cli- 
ent) desires to display some information, the informa- 
tion is communicated to the server portion of the co- 
processor 200 which then stores the information in 
the shared memory 158. The graphics processor 160 
then processes that information and stores it in th 
data memory 154 for display. In that manner, and un- 
der the control of the graphics processor 160, the 
plurality of displays, i.e., windows, is displayed on the 
CRT 151. 

It will be understood by those skflled in the art 
that the X-window protocol is essentially the open in- 



terface standard, th X-window protocol being readily 
available and well known to those skilled in the art. 
In the preferred embodiment the UNIX operating sys- 

5 tern is utilized, the UNIX operating system being able 
to run on many commercially available processors. 
Further information on the preferred embodiment of 
the graphics card 150 of the preferred embodiment of 
the US 122 can be had by reference to U.S. Patent 

10 Numbers 4,490,797 and 4,663.61 9. although it will be 
understood that any graphics card can be utilized as 
discussed above. The graphics processor 160 of the 
preferred embodiment of the present invention is a 
Texas Instruments (Tl) TMS 34020. The microproces- 

15 sor 1 56 and the module CPU 38 is a Motorola 68020. 
The co-processor 200 of the preferred embodiment of 
the present invention is a Motorola 68040, having bus 
capability with the other microprocessors of the sys- 
tem. It will be understood that a variety of processors 

20 can be utilized including a reduced instruction set 
processor which is available from Hewlett Packard 
among other processor manufacturers. 

Although the preferred embodiment utilizes the 
UNIX operating system, it will be recognized by those 

25 skilled in the art that any operating system can be util- 
ized, including OSF1, Open Systems Founda- 
tion/USA, Cambridge, Massachusetts. Although the 
co-processor 200 is controlling the display in the pre- 
ferred embodiment the graphics card can also per- 

30 form the display control. Since X-windows was read- 
ily available and performed the desired display con- 
trol function, X-windows was utilized to take advan- 
tage of the availability of the desired control function. 
It will be recognized by those skilled in the art that im- 

35 piemen tation of the present invention is not limited to 
X-windows, and that any protocol can be utilized. 

Thus it can be seen that the process control sys- 
tem 10 is open system permitting other system to in- 
terface into the LCN of the process control system 

40 and, because of the communication scheme as de- 
scribed above, the integrity of the process control 
system 10 is maintained. Further, the graphics card 
150, although not in immediate control of the display 
unit 151, guarantees that the graphic view (control 

45 view) to a field device (i.e., valve,. ..) or any other con- 
trols view of the process control systemon thedisplay 
unit is always maintained regardless of the operation- 
al state of the co-processor 200. If the co-processor 
200 is running and controlling the display unit 151 

so (and in particular the actual display on the screen of 
the display unit 151) and a malfunction occurs or 
some other anomaly occurs to the co-processor 200, 
the function of the graphics card 150guarante sthat 
a single view of th process control system is main- 

55 tained. As discussed above, the co-processor is con- 
nect d into the US 122 and has and controls a graph- 
ical interface through the display 151 and keyboard 
153. 

Referring to Figure 7, which comprises Figures 
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7 A and 7B, there is shown an example of two displays 
of the display unit 151. Figure 7A shows an example 
of a typical normal display and Figure 7B shows a dis- 
play when an anomaly occurs with the co-processor 5 
200, or the fallback display. Figure 7A shows, for ex- 
ample, the windows which can be displayed. The win- 
dows always include a "view of the process", i.e., a 
control view from the process control system 10. Also 
included can be, for example, a window showing 10 
event history (a process control system application) 
coming from an outside system, running a process 
control system application, for example a DEC com- 
puter system 300 as shown in Figure 5. Another win- 
dow can be data coming from another outside com- 15 
puter system (not shown), for example such as an Ap- 
ple computer. This computer system car be running 
another application program referred to as documen- 
tation (in the preferred embodiment of the process 
control system the documentation of the process con- 20 
trol system is created on an Apple computer). Still an- 
ot her window can be displayed, for example, lab data, 
coming from a Hewlett Packard computer system. 
The windows, except for the control view, are dis- 
played on a single screen of the display unit 1 51 , the 25 
display information for these windows coming from a 
number of outside computer systems connected into 
the co-processor 200. If an error is detected with the 
co-processor 200, the method of the present inven- 
tion guarantees that the display windows from the 30 
outside systems are inhibited and the control view is 
the only display shown and is zoomed to take up the 
entire screen of the display unit 151 . This observation 
also serves as an indication to the operator that a 
malfunction has occurred with the interface to the 35 
outside systems. 

The utilization of a low resolution touch screen 
system in a high resolution graphics environment, the 
method of the present invention, will now be descri- 
bed. The display of the present invention has a 1280 40 
by 1024 resolution, i.e., 1280 pixels wide by 1024 pix- 
els high. A single character on the display is an 8 by 
8 pixels character, and it is desirable to be able to pos- 
ition to a character. The touch screen system of the 
present invention is an infrared technology having X 45 
coordinate and Y coordinate beams across the dis- 
play which are broken upon pointing to a desired pos- 
ition of the display. The pointing can be done by a fin- 
ger (a pen, pencil, stylus,...) which breaks the beams. 
As is well known to those skilled in the art one side so 
of the touch screen system includes LEDs and on the 
opposite side sensors are placed which receive the 
signal from the LEDs. When the beam is broken a re- 
port is transmitted by the touch screen system to an 
information processing apparatus identifying the co- 55 
ordinate inputs of the position desired. In order for a 
report to be transmitted, both an X beam and a Y 
beam must be broken. The present invention utilizes 
a touch screen having a resolution of 127 wide by 95 



high. Thus for an 8 by 8 character size, a display re- 
solution of 1280 by 1024 has a resultant target reso- 
lution of 160 wide by 128 high. In this particular in- 
stance the target r solution is higher then the touch 
screen resolution, the touch screen resolution being 
127 by 95. Thus the desired objective of being able 
to position to a character cannot be met. 

In order to be able to achieve the desired objec- 
tive of positioning to a single character, the display is 
zoomed such thatthe character resolution around the 
reported position has a character resolution of 16 by 
16. This results in a target resolution of 80x64. As a 
result of the lower target resolution, the touch screen 
resolution of 1 27 wide by 95 high results in having at 
least one beam cross a character, being able to pos- 
ition to a desired character. 

The method of the present invention is shown in 
Figure 8. Referring to Figure 8 there is shown a flow 
diagram of the method of the present invention. 
When the finger (or stylus) is inserted onto the touch 
screen such that an X and Y beam are broken (block 
410), a report is received by the information handling 
apparatus, in the preferred embodiment the graphics 
processor 1 60 of the process control system 1 0. Upon 
the first entry of the finger or stylus onto the display 
screen, the report also indicates that this is an entry 
report (block 415). The graphics processor 160 
checks to verify whether this is the first report (block 
420) and if it is sets a first report flag (block 425). The 
raw Xo and Y D positions from the touch screen system 
is accepted by the graphics processor 160 (block 
430). The graphics processor calculates Xo (CALC) 
and a Y e (CALC) utilizing the RAW Xo and RAW Y Q 
positions from the touch screen systems (block 435). 
The coarsen position Xc, Y c is also determined using 
the equations: 

Xc = X, (RAW) * 10.15 
Y c = Y, (RAW) * 10.88 ; 
where X, = Xo for the first report. These positions, i.e., 
the RAW positions and calculated positions are saved 
(block 440), and the graphics processor zooms 
around the Xo and the Y c calculated position (block 
445). In the preferred embodiment of the present in- 
vention, a 20 by 20 character area is zoomed around 
the Xo and Y c calculated a backward calculation to de- 
termine the position of the desired character. The 
screen is restored (block 480) and the first report flag 
is cleared (block 485). This processinc routine for the 
touch screen system is then exited. 
Referring to Figure 9 there is shown a partial display 
screer showing row 1 of characters 16 through 19. 
The X positior pixels and Y position pixels of the dis- 
play sere n are alsc shown for the pertinent charac- 
ters. The touch scr en apparatus includes only the X 
beams (but will also apply for the Y beams although 
not shown). Beams 12, 13, and 14 are shown inter- 
secting characters 16, 18, and 19. This is because the 
resolution of the touch screen apparatus as men- 
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tioned above is lower than the target resolution, as- 
suming for purposes of example here that th target 
character is character 17. With a touch screen reso- 
lution of 127 by 95 pixels for the touch screen and a 
target resolution of 160 by 128, the beams can only 
cross approximately one out of every ten pixels. Thus 
for a character having 8 pixels there will be a number 
of characters which will not have an intersecting or 
crossing beam. Referring to Figure 10, there is shown 
a partial zoomed area of the display of Figure 9. Gen- 
erally the finger or stylus will break 2 or 3 beams, rare- 
ly 4 beams in each direction. Let's assume for purpos- 
es of example that X beams 12, 13, and are broken, 
character 17 being the character attempted to pointed 
to (i.e., the desired character). The X coordinate pos- 
ition for beam 13 is transmitted as the Xo RAW posi- 
tion. The calculated positions effectively convert the 
X and Y coordinate of the touch screen system to the 
corresponding X and Y coordinate of the display 
screen, which is how the factors 10.15 and 10.88 are 
determined. 

A new report is transmitted to the graphics proc- 
essor 1 60 by the touch screen system about every 
1/16 of a second, i.e., 16 reports per second. Since 
the initial report, as a result of placing the f inger onto 
the touch screen, may not result in identifying the de- 
sired character, the finger or stylus may be moved. 
On each subsequent report, since the finger or stylus 
is still on the screen, the exit report check of block 41 5 
will indicate a no; however, the first report determina- 
tion will also be a no thus proceeding to block 450. 
The graphics processor 1 60 accepts the RAW X, and 
Yj data from the touch screen system (block 450), and 
generates an X d and Y d position, and an X p and Y p 
position (block 455). All coordinates received afterthe 
initial coordinates as treated as relative coordinates. 
This is done by receiving the new RAW coordinates 
X| and Yj from the touch screen system and then sub- 
tracting the Xo and Y G RAW coordinates and multiply- 
ing the difference by 5.08 for the X coordinate and 
5.44 for the Y coordinate. X<, and Y d are then added 
to the initial Xo and Y c absolute display coordinate val- 
ues resulting in a new point position relative to the ini- 
tial touch coordinates. Since the multiplication con- 
stants is 1/2 the original multiplication constants, the 
result is that the relative position of the new point is 
1/2 the display resolution and therefore obtains the 
same result as a 640 by 51 2 display system for select- 
ing the target. Thus, in order to be effective at 1/2 the 
display resolution in the relative mode, the display is 
zoomed by a factor of two. Forthis reason, the display 
is zoomed around the area of the original touch by a 
factor of two, i.e., 16 by 1 6 pixel character size. A new 
position for the cursor is calculated (block 457). Thus 
the Xd, Y d are saved (block 456) along with the newly 
calculated X and Y position X p and Y p . A check is 
made to determine if the new point X p and Y p are in 
the zoomed area (block 458). If it is, the processing 



continues at block 415. If the new point is outside the 
zoomed area, th original screen is restored (block 
460), and the display is then rezoom d around newly 

5 calculated Xp and Y p (block 465) but placed on th 
screen centered around Xc, Y c . The characters are 
zoomed to a 1 6 by 1 6 pixel size and showing a 20 by 
20 character around the new center position. As an al- 
ternative, block 458 can be omitted. Thus, the finger 

10 or stylus is moved, the zoomed area follows the sty- 
lus at half the distance (or half the "speed") such that 
ultimately the desired character is pointed to by the 
finger or stylus. When the desired character is point- 
ed to (by the finger and thus by the cursor), this sit- 

15 uation occurs the finger or stylus is withdrawn. When 
this occurs the touch screen system transmits an exit 
report to the graphics processor 1 60 and the graphics 
processor now has the Xp and p position (block 475) 
and performs value. 

20 According to the present invention character 18 

will be the "pointed to" character such that character 
1 8 will be zoomed to a 16 by 16 character size (includ- 
ing 20 by 20 characters around that initial position ac- 
cording to the present invention). Since character 17 

25 is the desired character, as the finger is moved to- 
wards character 17 the cursor will follow. (For the al- 
ternative embodiment, i.e., without block 458, the 
zoomed area moves at "half the speed" in a relative 
manner.) At a point in time when character 17 is below 

30 the finger, finger is withdrawn. The beam positions 
are transmitted to the processing device which will 
calculated the Xp and Y p position which identifies 
character 17, in accordance with the method of the 
present invention as described above. When the f in- 

35 ger is withdrawn the display is restored to its original. 

While there has been shown what is considered 
the preferred embodiment of the present invention, it 
will be manifest that any changes and modifications 
can be made therein without departing from the es- 

40 sential spirit and scope of the invention. It is intended, 
therefor, in the annexed claims to cover all such 
changes and modifications which fall within the true 
scope of the invention. 

45 

Claims 

1. Apparatus for selecting a character being dis- 
played on a display using a pointer element, 

so wherein the display has a first resolution and a 

touch screen system associated with the display 
has a second resolution, and wherein the charac- 
ter has a third r solution resulting in a target re- 
solution, and further wherein the target resolution 

55 is higher that the resolution of the touch screen 

system, the touch screen syst m transmitting to 
a data processing unit processing the display, 
and X and Y coordinate signal of the character 
pointed to, the apparatus characterised by:- 
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a) means, when a character is pointed to, to 
accept an initial X and Y coordinate value from 
the touch screen system; 

b) means to calculate a corresponding X and 5 

Y coordinate value of the display; 

c) means to save the initial X and Y coordinate 
values and the corresponding calculated X 
and Y coordinate values; 

d) means to zoom the display a predeter- 10 
mined number of characters around the initial 

X and Y coordinate values; 

e) means to move the pointer element to- 
wards the character to be selected if the char- 
acter is not under the pointer; 1 5 

f) means to continue to accept updated X and 

Y coordinate position values of the current 
pointer location on a periodic basis; 

g) means to calculate a new point to zoom the 
display, the new point following the pointer 20 
element at a predetermined speed less than 

the speed of the pointer element; 

h) means, if the new point is within the 
zoomed area, to proceed to moving means 

(e). otherwise to proceed to the next step; 25 

i) means to restore the display; 

j) means to rezoom the display around the 
new point; 

K) means to repeat the operation from step (e) 

until the desired character is under the poin- 30 

ten and 

I) means to withdraw the pointer element, the 
new point calculated from step (g) having the 
X and Y coordinate values of the desired char- 
acter, thereby permitting the desired charac- 35 
ter to be selected when the target resolution 
is higher than the resolution of the touch 
screen system. 

Apparatus according to Claim 1 characterised in 40 
that zooming means comprises: 

means to zoom each character within the 
predetermined number of characters around the 
initial X and Y coordinate values wherein each of 
the zoomed characters has a fourth resolution, 45 
such that the resultant target resolution is less 
than the resolution of the touch screen system, 
thereby permitting a predetermined character to 
be selected using the pointer element. 

50 

Apparatus according to Claim 1 characterised by 
rezooming means to rezoom the display around 
the new point centred around a cursor position, 
the cursor position being essentially the position 
of the pointer element 55 

Apparatus according to any preceding Claim 
characterised in that the fourth resolution, the re- 
solution of the zoomed characters, is twice the 



third resolution, the resolution of the characters 
displayed on the display. 

5. Apparatus according to any preceding Claim, 
characterised in that the predetermined number 
of characters zoomed around the initial X and Y 
coordinates is 20 characters by 20 characters. 

6. Apparatus according to any preceding Claim, 
characterised in that the means to calculate a 
new point to zoom the display generates the new 
point coordinates from the current pointer loca- 
tion to a relative position from the initial X and Y 
coordinate value, the relative position being a 
factor less than one, such that at the pointer ele- 
ment is moved the pointer element ultimately gets 
to a position on the display wherein the pointer 
element points to the desired character. 

7. Apparatus according to Claim 6 characterised in 
that the factor used to determine the relative pos- 
ition of the new point is one half. 

8. Apparatus for selecting a character being dis- 
played on a display using a pointer element, 
wherein the display has a first resolution and a 
touch screen system associated with the display 
has a second resolution, and wherein the charac- 
ter has a third resolution resulting in a target re- 
solution, and further wherein the target resolution 
is higher than the resolution of the touch screen 
system, the touch screen system transmitting to 
a data processing unit processing the display, 
and X and Y coordinated signal of the character 
pointed to, the apparatus characterised by> 

a) means, when a character is pointed to, to 
accept an initial X and Y coordinate value from 
the touch screen system; 

b) means to calculate a corresponding X and 

Y coordinate value of the display; 

c) means to save the initial X and Y coordinate 
values and the corresponding calculated X 
and Y coordinate values; 

d) means to zoom the display a predeter- 
mined number of characters around the initial 
X and Y coordinated values; 

e) means to move the pointer element to- 
wards the character to be selected if the char- 
acter is not under the pointer, otherwise 
means to proceed to withdrawing means of 
(k); 

f) means to continue to accept updated X and 

Y coordinate position values of the current 
pointer location on a periodic basis; 

g) means to calculate a new point to zoom the 
display, the new point following the pointer 
element at a predetermined speed less than 
the speed of the pointer element; 
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h) means to restore the display; 

i) means to r zoom the display around the 
new point; 

j) means to repeat the method from stage (e) 5 
until the desired character is under the poin- 
ter; and 

k) means to withdraw the pointer element, the 
new point calculated from stage (g) having the 
X and Y coordinate values of the desired char- w 
acter, thereby permitting the desired charac- 
ter to be selected when the target resolution 
is higher than the resolution of the touch 
screen system. 

15 

A method for selecting a character being dis- 
played on a display using a pointer element, 
wherein the display has a first resolution and a 
touch screen system associated with the display 
has a second resolution, and wherein the charac- 20 
ter has a third resolution resulting in a target re- 
solution, and further wherein the target resolution 
is higher that the resolution of the touch screen 
systems the touch screen system transmitting to 
a data processing unit processing the display, 25 
and X and Y coordinate signal of the character 
pointed to, the method characterised by:- 

a) when a character is pointed to, accepting 
an initial X and Y coordinate value from the 
touch screen system; 30 

b) calculating a corresponding X and Y coor- 
dinate value of the display; 

c) saving the initial X and Y coordinate values 
and the corresponding calculated X and Y co- 
ordinate values; 35 

d) zooming the display a predetermined num- 
ber of characters around the initial X and Y co- 
ordinate values; 

e) moving the pointer element towards the 
character to be selected if the character is not 40 
under the pointer; 

f) continuing to accept updated X and Y coor- 
dinate position values of the current pointer 
location on a periodic basis; 

g) calculating a new point to zoom the display, 45 
the new point following the pointer element at 

a predetermined speed less than the speed of 
the pointer element; 

h) if the new point is within the zoomed area, 
proceeding to step (e), otherwise proceeding so 
to the next step; 

i) restoring the display; 

j) rezooming the display around the new point; 
k) repeating the operation from step (e) until 
thedesiredcharacterisunderthepointer; and 55 
I) withdrawing the pointer element, the new 
point calculated from step (g) having the X 
and Y coordinate values of the desired char- 
acter, thereby permitting the desired charac- 



ter to be selected when the target resolution 
is higher than the resolution of the touch 
screen system. 

10. A method according to Claim 1 characterised in 
that the step of zooming comprises the step of: 
zooming each character within the prede- 
termined number of characters around the initial 
X and Y coordinate values wherein each of the 
zoomed characters has a fourth resolution, such 
that the resultant target resolution is less than 
the resolution of the touch screen system, there- 
by permitting a predetermined character to be se- 
lected using the pointer element 

11.. A method according to Claim 9 or 10 character- 
ised in that the step of rezooming the display 
comprises the steps of: 

rezooming the display around the new 
point centred around a cursor position, the cursor 
position being essentially the position of the poin- 
ter element. 

12. A method according to any of Claims 9 to 11 char- 
acterised in that the fourth resolution, the reso- 
lution of the zoomed characters, is twice the third 
resolution, the resolution of the characters dis- 
played on the display. 

1 3. A method according to any of Claims 9 to 1 2 char- 
acterised in that the predetermined number f 
characters zoomed around the initial X and Y co- 
ordinates is 20 characters by 20 characters. 

1 4. A method according to any of Claims 9 to 1 3 char- 
acterised in that the step of calculating a new 
point to zoom the display generates the new point 
coordinates from the current pointer location to a 
relative position from the initial X and Y coordin- 
ate value, the relative position being a factor less 
than one, such that as the pointer element is 
moved the pointer element ultimately gets to a 
position on the display wherein the pointer ele- 
ment points to the desired character. 

15. A method according to Claim 14 characterised in 
that the factor used to determine the relative pos- 
ition of the new point is one half. 

16. A method for selecting a character being dis- 
played on a display using a pointer element, 
wherein the display has a first resolution and a 
touch screen system associated with the display 
has a second resolution, and wherein the charac- 
ter has a third resolution resulting in a target re- 
solution, and furtherwherein the target resolution 
is higher than the resolution of the touch screen 
system, the touch screen system transmitting to 
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a data processing unit processing th display, 
and X and Y coordinat signal of the character 
pointed to, the method characterised by the 
steps of:- 5 

a) when a character is pointed to, accepting 
an initial X and Y coordinate value from the 
touch screen system; 

b) calculating a corresponding X and Y coor- 
dinate value of the display; 10 

c) saving the initial X and Y coordinate values 
and the corresponding calculated X and Y co- 
ordinate values; 

d) zooming the display a predetermined num- 
ber of characters around the initial X and Y co- 15 
ordinated values; 

e) moving the pointer element towards the 
character to be selected if the character is not 
under the pointer, otherwise proceeding to 
step (k); 20 

f) continuing to accept updated X and Y coor- 
dinate position values of the current pointer 
location on a periodic basis; 

g) calculating a new point to zoom the display, 

the new point following the pointer element at 25 
a predetermined speed less than the speed of 
the pointer element; 

h) restoring the display; 

i) rezooming the display around the new point; 

j) repeating the method from stage (e) until 30 
the desired character is under the pointer; and 
k) withdrawing the pointer element, the new 
point calculated from stage (g) having the X 
and Y coordinate values of the desired char- 
acter, thereby permitting the desired charac- 35 
ter to be selected when the target resolution 
is higher than the resolution of the touch 
screen system. 
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@ A method for utilizing a low resolution 
environment. 

@ A relatively low resolution touch screen sys- 
tern is utilized In a graphic display environment 
wherein the resolution of the graphic display is 
relatively high. The character resolution yields a 
lower target resolution, a single character being 
the target (or the desired character). The 
method zooms a predetermined number of 
characters around an initially reported position, 
the zooming Increasing the character resol- 
ution such that target resolution is de c re as e d to 
a value resulting In a touch screen resolution at 
least equal to or higher than resolution of the 
target resolution. Further, as the stylus is moved 
toward the desired character, a new position of 
the stylus is calculated. A check is made to 
determine If the new position is within the 
zoomed area. If it is, the processing continues : 
otherwise the screen Is rezoomed around the 
new position. When the desired character is 
under the pointing element, the pointing ele- 
ment utilized to reverse the calculation thereby 
identifying the position of the desired character, 
and thus the desired character itself. 
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